Directional sound capturing

ABSTRACT

This disclosure is directed to a sound recording arrangement comprising a sound recording arrangement and a method in the sound recording arrangement for amplifying sounds in a primary gaze direction of the user of the sound recording arrangement. The method comprises the actions of recording sounds arriving at a sound recording unit from objects in the field of view of the user, and recording a first set of images of the head and/or the eyes of the user, and determining a primary gaze direction of the user based on the first set of images, and amplifying sounds arriving in the primary gaze direction compared to sounds arriving from other directions.

TECHNICAL HELD

The present invention relates to the field of directional soundcapturing and more particularly to a device and a method for capturingsound from a certain direction or certain directions. Particular aspectsof the invention relate to directional sound capturing in a portabledevice.

BACKGROUND OF THE INVENTION

It is generally known that sound can be captured by means of microphonesof various kinds. It is also known that sound from a particulardirection can be captured by means of directional microphones with theeffect that sound from a particular direction is amplified compared tosounds from other directions, and/or that sounds from other directionsare attenuated compared to the sound from the particular direction.

However, directional microphones will normally capture sound in aparticular fixed direction. This direction may not be the direction ofinterest to a user of the directional microphone, or the user of theapparatus comprising the directional microphone.

The problem that a directional microphone may only capture sound in afixed direction may e.g. be solved by attaching the directionalmicrophone to a movable object such that the directional microphone canbe directed in various directions. However, the direction into which thedirectional microphone is currently directed may still not be thedirection of interest to a user of the directional microphone. This isparticularly so if the direction of interest is frequently changed,which e.g. may be the case if the user is interested in capture soundfrom a moving object such as a moving person or similar.

The problem that the direction of interest is frequently changed maye.g. be solved by attaching the directional microphone to the head ofthe user, such that the user may turn his head in the direction ofinterest with the effect that the directional microphone will capturesounds in that direction.

However, this requires that the user keeps his head turned in thedirection of interest, which is not always convenient or even possible.It may e.g. be necessary for the user to listen to someone positioned ina certain direction while at the same time performing a task requiringthe user to turn his head at another direction.

SUMMARY OF THE INVENTION

In view of the above there seems to be a need for an improved scheme fordetecting sound from a certain direction or certain directions. Thuspresent invention is directed to solving the problem of providing animproved scheme for detecting sound from a certain direction or fromcertain directions.

This has been achieved according to a first embodiment of the presentinvention which provides a sound recording arrangement comprising asound recording unit capable of operatively record sounds arriving atthe sound recording unit from objects in the field of view of a user ofthe sound recording arrangement. The sound recording arrangementcomprises a first image recording unit that is configured to operativelyrecord a first set of images of the head and/or the eyes of the user,and a control unit that is configured to operatively determine a primarygaze direction of the user based on the first set of images, whichcontrol unit is further configured to operatively amplify soundsarriving in the primary gaze direction compared to sounds arriving fromother directions.

This has also been achieved according to another embodiment of thepresent invention which provides a method in the sound recordingarrangement for amplifying sounds in a primary gaze direction of theuser of the sound recording arrangement. The method comprises theactions of recording sounds arriving at a sound recording unit fromobjects in the field of view of the user, and recording a first set ofimages of the head and/or the eyes of the user, and determining aprimary gaze direction of the user based on the first set of images, andamplifying sounds arriving in the primary gaze direction compared tosounds arriving from other directions.

It should be emphasized that the term “comprises/comprising” when usedin this specification is taken to specify the presence of statedfeatures, integers, steps or components, but does not preclude thepresence or addition of one or more other features, integers, steps,components or groups thereof.

It should also be emphasized that the methods defined by the appendedclaims may comprise further steps in addition to those mentioned and thesteps mentioned may be performed in another sequence than the one givenwithout departing from the present invention.

Further advantages of the present invention and embodiments thereof willappear from the following detailed description of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 shows a schematic illustration of an exemplifying scenariowherein an exemplifying sound recording arrangement 10 amplifies soundsarriving in at least one primary gaze direction 22 or 24;

FIG. 2 is a schematic illustration of some relevant parts of the soundrecording arrangement 10 in FIG. 1.

FIG. 3 is a schematic flowchart illustrating a method according to anembodiment of the present invention.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

An exemplifying sound recording arrangement 10 according to anembodiment of the present solution is schematically illustrated in FIG.1 and in FIG. 2. The sound recording arrangement 10 may be anyelectronic unit, e.g. a hearing aid arrangement or similar or a head setfor professional use or for use during gaming activities or any othersuitable sound recording and sound reproducing arrangement or similar.

The sound recording arrangement 10 comprises a sound recording unit 12capable of operatively capture sounds arriving at the sound recordingunit 12 from objects in the field of view of a user 20 of the soundrecording arrangement 10, and a first image recording unit 14 aconfigured to operatively record a first set of images of the headand/or the eyes of the user 20, and a control unit 18 that is configuredto operatively determine a primary gaze direction 22 and/or 24 of theuser 20 based on the first set of images, and that is further configuredto operatively amplify sounds arriving in the primary gaze direction 22and/or 24 compared to sounds arriving from other directions. This maye.g. be accomplished by amplifying sounds in the gaze direction, whilesounds from other directions may be recorded without amplification.Alternatively, this may e.g. be accomplished by amplifying sounds in thegaze direction, while sounds from other directions may be attenuated.Alternatively, this may e.g. be accomplished by recording sounds in thegaze direction without amplification while sounds from other directionsmay be attenuated, which in fact means that sounds in the gaze directionare amplified compared to other sounds. In embodiments of the presentsolution it may be preferred that sounds in the gaze direction and theother sounds are mixed, while the sounds in the gaze directions areamplified compared to the other sounds. The level of amplification ofthe sounds in the gaze direction may be adjustable and/or set to apredetermined level, e.g. depending on the user's which and/or dependingon the working environment wherein the sound recording arrangement 10 isto be used.

It is preferred that the sound recording unit 12 comprises a cluster ofsound recording devices, e.g. a first sound recording device 12 a and asecond sound recording device 12 b, e.g. arranged to operatively receivesounds omnidirectional, or within a circle sector of less than 45°, orless than 90°, or less than 135°, or less than 180°, or less than 225°,or less than 270°, or less than 315°. A person skilled in the artrealizes that the direction from which sounds are arriving at the soundrecording unit 12 can be determined by using the first and the secondsound recording devices 12 a, 12 b, e.g. by comparing the timing of thesound arriving at the first sound recording device 12 a and the secondsound recording device 12 b. This may e.g. require knowledge of thespeed of sound and the distance between the first and the second soundrecording units 12 a, 12 b etc. Similarly, person skilled in the artrealizes that sounds arriving at the sound recording unit 12 can beamplified in various directions by using the first sound recording unit12 a and the second sound recording unit 12 b, e.g. by varying therelative phase of the sound arriving at and recorded by the first soundrecording unit 12 a and the second sound recording unit 12 brespectively. This is the same well known technique that is used forphased array antennas comprising a group of antennas, wherein therelative phases of the respective signals received from the antennas arevaried in such a way that the effective antenna diagram of the array isreinforced in a desired direction, and typically also suppressed inundesired directions. The difference here is that a typical phased arrayantenna operates in the microwave spectrum, whereas the sound recordingunit 12 and the two sound recording devices 12 a, 12 b operate in theaudible spectrum. When two sound recording devices 12 a, 12 b then thesound recording arrangement 10 will be able to amplify sounds arrivingin one angular dimension only, e.g. in azimuth (i.e. the horizontaldirection) or in elevation (i.e. the vertical) direction) based onsounds recorded by the two sound recording devices 12 a and 12 b.However, if a third sound recording device 12 c is added then the soundrecording arrangement 10 will be able to amplify sounds arriving in twoangular dimensions, e.g. in an azimuth (i.e. horizontal) direction andin an elevation (i.e. vertical) direction based on sounds recorded bythe three sound recording devices 12 a, 12 b and 12 c. Here, it ispreferred that the three sound recording devices 12 a, 12 b and 12 c arearranged in a non-linear fashion, e.g. arranged in a triangle pattern oraccording to any other suitable polygonal pattern. A skilled personhaving the benefit of this disclosure realizes that the sound recordingunit 12 may have one, two, three or more sound recording devices. Two ormore sound recording devices may e.g. be arranged in a linear fashionand/or in a polygonal fashion or similar, e.g. in a two or threedimensional array or similar.

It is preferred that the first image recording unit 14 a comprises oneor more camera arrangements or similar that are configured tooperatively record images of the head and/or the eyes of a user 20 ofthe sound recording arrangement. One camera arrangement may e.g. recordone eye and another camera arrangement may record the other eye of theuser 20. The first image recording unit 14 a may e.g. comprise one ormore still cameras, e.g. a digital still camera, preferably configuredto record a number of consecutive by separate images of the user 20. Thefirst image recording unit 14 a may e.g. comprise one or more motionpicture cameras, e.g. a digital video camera, which is configured tocontinuously record the user's motions.

The sound recording arrangement 10 may also comprise a second imagerecording unit 14 b configured to operatively record images of the fieldof view of the user 20 of the sound recording arrangement 10. It shouldbe explained that the field of view of the user 20 corresponds to thewhole or at least a part of the view of the surroundings that a user 20can see while using the sound recording arrangement 10. It is preferredthat the second image recording unit 14 b is a camera arrangement orsimilar configured to operatively record images of the field of view.The second image recording unit 14 b may e.g. be a still camera, e.g. adigital still camera, which is configured to record a number ofconsecutive by separate images of the field of view. The second imagerecording unit 14 b may e.g. be a motion picture camera, e.g. a digitalvideo camera, which is configured to continuously record the field ofview.

The sound recording arrangement 10 may also comprise a sound producingunit 19. The sound producing unit 19 is configured to operativelyprovide the user 20 of the sound recording arrangement 10 with soundcaptured by the sound recording unit 12, wherein the sound arriving atthe sound recording unit 12 in the gaze direction 22 and/or 24 of theuser 20 has been amplified, as will be elaborated in more detail later.The sound producing unit 19 may be any sound producing unit that isknown by those skilled in the art to be suitable for the purposesdescribed herein. The sound producing unit 19 may e.g. comprise aloudspeaker or similar configured to operatively produce sounds that canbe heard by the user 20, e.g. sounds within the frequency range of20-20,000 Hz.

In addition, the sound recording arrangement 10 may comprise a distancemeasuring unit 16. The distance measuring unit 16 is configured tooperatively obtain the distance to an object 40 a and/or 40 b in thegaze direction 22 and/or 24 respectively as will be elaborated in moredetail later. The distance measuring unit 16 may be any distancemeasuring unit known by those skilled in the art to be suitable for thepurposes described herein. The distance measuring unit 16 may e.g.comprise a sound measuring unit configured to measure distances bysending a sound pulse such as an ultrasound pulse or similar to a targetand then measure the time it takes for the sound pulse to be reflectedoff the target and back to the unit in question. Alternatively, thedistance measuring unit 16 may e.g. comprise light such as laser orinfrared in a measuring unit configured to measure distances by sendinga light pulse or similar to a target and then measure the time it takesfor the pulse to be reflected off the target and back to the unit inquestion. Alternatively, the distance measuring unit 16 may e.g.comprise an autofocus arrangement which directly or indirectly providesthe distance to an object 40 a and/or 40 b in the gaze direction 22and/or 24 respectively being in focus. The autofocus arrangement maye.g. be a part of the second image recording unit 14 b configured tooperatively record images of the field of view of the user 20 of thesound recording arrangement 10. Alternatively, the distance measuringunit 16 may e.g. use images of the two eyes of a user 20 of the soundrecording arrangement 10, which images are recorded by the first imagerecording unit 14 a. The distance measuring unit 16 may then beconfigured to operatively estimate the distance to an object 40 a and/or40 b at which the user 20 gazes by detecting the vergence of the eyes.It is well known to those skilled in the art that the vergence is thesimultaneous movement of both eyes in opposite directions to obtain ormaintain single binocular vision.

The control unit 18 of the sound recording arrangement 10 may beimplemented using hardware and/or software, e.g. in the form of specialdedicated programs running on hardware in the form of anApplication-Specific Integrated Circuit (ASIC) or similar. The controlunit 18 is configured to control, monitor and/or communicate with theother parts and functions of the sound recording arrangement 10 so as toperform the actions or similar of the embodiments described herein. Inparticular, the control unit 18 may be configured to control, monitorand/or communicate with the sound recording unit 12, the first imagerecording unit 14 a, and the second image recording unit 14 b, and thedistance measuring unit 16 and the sound producing unit 19.

Before proceeding it should be added that the sound recording unit 12,the first image recording unit 14 a, the second image recording unit 14b, the distance measuring unit 16, and the sound producing unit 18 maybe attached to, or arranged within the sound recording arrangement 10and/or connected to the sound recording arrangement 10. The connectionmay e.g. be a wired or a wireless connection.

FIG. 3 is a schematic flowchart illustrating a method according to anembodiment of the present solution. The flowchart is discussed belowwith reference to the sound recording arrangement 10 described abovewith reference to FIG. 1 and FIG. 2. However, the discussion appliesmutatis mutandis to all sound recording arrangement with sound recordingcapabilities and image recording capabilities that are configured tooperatively perform the actions according to embodiments of the presentsolution.

In a first action A1 it is preferred that sound arriving at the soundrecording unit 12 from objects in the field of view of the user 20 ofthe sound recording arrangement 10 is recorded by, preferably by usingthe sound recording unit 12. The field of view of the user 20 maycorrespond to the view that the user 20 may look at or is currentlylooking at, in other words what the user 20 may see or what the user 20currently sees. As schematically illustrated in FIG. 1, the objects maye.g. be a first person 40 a and/or a second person 40 b. The user 20 maye.g. talk and/or listen to the first person 40 a and/or the secondperson 40 b.

in a second action A2 it is preferred that a first set of images of thehead and/or the eyes of the user 20 is recorded, preferably by using thefirst image recording unit 14 a.

In a third action A3 it is preferred that a primary gaze direction ofthe user 20 is determined based on the first set of images recorded inthe second action A2. FIG. 1 schematically illustrates a first primarygaze direction 22, and a second primary gaze direction 24. In the firstprimary gaze direction 22 the user gazes at a first object 40 a, and inthe primary second gaze direction 24 the user 20 gazes at a secondobject 40 b. A primary gaze direction is preferably determined when theuser 20 repeatedly gazes in a particular direction in the field of view,and/or when the user 20 gaze in a direction in the field of view under apredetermined period. Glancing around in the field of view and/orshortly looking at an object in the field of view will not be enough todetermine a primary gaze direction. As can be seen in FIG. 1, there maybe one or several primary gaze directions,

The primary gaze direction is preferably determined by the control unit18 operating on the first set of images by means of a suitable gazetracking algorithm or similar. The gaze tracking algorithm may operateby only tracking the movements of one eye or both eyes of the user 20,e.g. in case the first set of images are recorded by a head mountedimage recording unit 14 a. The gaze tracking algorithm may operate bytracking the head movements and/or tracking the movements of one eye orboth eyes of the user 20, e.g. in case the first set of images arerecorded by a table mounted image recording unit 14 a. A person skilledin the art having the benefit of this disclosure realizes that there isa wide range of well known gaze tracking algorithms suitable for thepurposes described herein. Thus the particular features of suitable gazetracking algorithms need no detailed description as such.

The control unit 18 may alternatively start the third action bydetermine a secondary gaze direction of the user 20 based on the firstset of images, where the sound recording arrangement 10 may comprise asecond image recording unit 14 b configured to operatively record asecond set of images of an object 40 a and/or 40 b in the field of viewof the user 20, which object 40 a and/or 40 b is located in thesecondary gaze direction. The control unit 18 may then determine theprimary gaze direction 22 and/or 24 of the user 20 based on the firstset of images as indicated above, and based on a correlation of thesecondary gaze direction and the an object tracking of the object 40 aand/or 40 b in the second set of images. Object tracking using images orsimilar of an object is well known per se by those skilled in the artand it needs no further description. This makes it possible to track amoving object if you yourself are moving or a combination. By usingobject tracking it is possible to smoothly follow an interesting movingsound source. In case this kind of object tracking is not done therecould be a bad tracking of the sound source because of the latency indetecting the interesting person/objector alternatively even loosingtrack of the sound source when it moves fast.

In a fourth action A4 it is preferred that only sounds in the primarygaze direction 22 and/or 24 is amplified. It is preferred that thecontrol unit 18 is configured to operatively amplify sounds in theprimary gaze direction 22 and/or 24. Other sounds outside the primarygaze direction 22 and/or 24 may alternatively or additionally beattenuated, i.e. sounds from other directions than primary gazedirection 22 and/or 24 may be attenuated. When applicable, it ispreferred that the control unit 18 is configured to operativelyattenuate such other sounds. In FIG. 1 an exemplifying amplification ina first primary gaze direction 22, which amplification has beenindicated by a conical shape 22 a, and an exemplifying amplification ina second primary gaze direction 24, which amplification has beenindicated by a conical shape 24 a. As can be seen, the amplification maybe compensated, e.g. for parallax differences, in case the soundrecording unit 12 and the user 20 are located at different positions.

As can be seen in FIG. 1 and FIG. 2, the sound recording unit 12 maycomprise a cluster of at least two sound recording devices 12 a, 12 b orat least three sound recording devices 12 a, 12 b, 12 c. Each soundrecording device 12 a, 12 b, 12 c is capable of operatively capturesound from objects in the field of view of the user 20. Here, it ispreferred that sounds is only amplified in the primary gaze direction 22and/or 24 in one angular dimension using said at least two soundrecording devices 12 a, 12 b, or in two angular dimensions using said atleast three sound recording devices 12 a, 12 b, 12 c. Again it ispreferred that the control unit 18 is configured to operatively amplifysounds in the primary gaze direction 22 and/or 24, and possibly toattenuate sounds outside the primary gaze direction 22 and/or 24.

As can be seen in FIG. 1 and FIG. 2, the sound recording unit 12 maycomprise a distance measuring unit 16 configured to operatively obtainthe distance to an object 40 a and/or 40 b in the primary gaze direction22 and/or 24 respectively. Here, the control unit 18 may be configuredto operatively amplify sounds in the primary gaze direction 22 and/or 24at the distance obtained by the distance measuring unit 16. For example,using the distance information it is possible to focus on sound comingfar away or closer and not indiscriminately amplify sound in a certaindirection.

In a fifth action A5 it is preferred that the amplification of the soundreceived in the primary gaze direction 22 and/or 24 is reduced when thetime during which the primary gaze direction 22 and/or 24 respectivelyremains the same drops below a predetermined threshold and/or thefrequency at which the same primary gaze direction 22 and/or 24 isrepeatedly determined drops below a predetermined threshold. In otherwords, if the time or frequency (or a combination) the user 20 looks atan object drops below some thresholds the amplification should bereduced. Additionally or alternatively, the amplification in a primarygaze direction 22 and/or 24 may be reduced when no sound is recordedduring a predetermined period in the primary gaze direction 22 and/or 24respectively. The amplification may be gradually reduced. Here, thecontrol unit 18 may be configured to operatively reduce theamplification as indicated above.

In a sixth action A6 it is preferred that the amplification of the soundreceived in the primary gaze direction 22 and/or 24 is raised when thetime during which the primary gaze direction 22 and/or 24 respectivelyremains the same and/or the frequency at which the primary gazedirection 22 and/or 24 respectively is repeated is above a predeterminedthreshold. In other words, when the time or frequency for a combination)the user 20 looks at an object 40 a and/or 40 b goes above somethresholds the amplification should be raised. The amplification may begradually raised. The amplification may be immediately raised when thecurrent primary gaze direction is the same as a previously determinedprimary gaze direction. Here, the control unit 18 may be configured tooperatively raise the amplification as indicated above.

Generally, sound in the primary gaze direction 22 and/or 24 may beamplified even if there is currently no sound arriving at the soundrecording unit 12 in the primary gaze direction 22 and/or 24respectively.

The embodiments discussed above may be summarized in the followingmanner:

One embodiment of the present solution may be directed to a soundrecording arrangement 10 comprising a sound recording unit 12 capable ofoperatively record sound arriving at the sound recording unit 12 fromobjects 40 a and/or 40 b in the field of view of a user 20 of the soundrecording arrangement 10. The sound recording arrangement 10 mayadditionally comprise a first image recording unit 14 a that isconfigured to operatively record a first set of images of the headand/or the eyes of the user 20, and a control unit 18 that is configuredto operatively determine a primary gaze direction 22 and/or 24 of theuser 20 based on the first set of images, which control unit 18 isfurther configured to operatively amplify sounds arriving in the primarygaze direction 22 and/or 24 compared to sounds arriving from otherdirections.

The control unit 18 may be configured to operatively determine asecondary gaze direction of the user 20 based on the first set ofimages, and the sound recording arrangement 10 may comprise a secondimage recording unit 14 b that is configured to operatively record asecond set of images of an object 40 a and/or 40 b located in thesecondary gaze direction, and the control unit 18 is configured tooperatively determine the primary gaze direction 22 and/or 24 of theuser 20 based on the first set of images and based on a correlation ofthe secondary gaze direction and an object tracking of the object 40 aand/or 40 b in the second set of images.

The sound recording unit 12 may comprise a cluster of at least two soundrecording devices 12 a and 12 b or at least three sound recordingdevices 12 a, 12 b and 12 c, each capable of operatively record soundsfrom objects in the field of view of a user 20. Here, the control unit18 may be configured to operatively amplify sounds in the primary gazedirection 22 and/or 24 in one angular dimension using said at least twosound recording devices 12 a and 12 b, or in two angular dimensionsusing said at least three sound recording devices 12 a, 12 b and 12 c.

The sound recording arrangement 10 may comprise a distance measuringunit 16 that is configured to operatively obtain the distance to anobject 40 a and/or 40 b in the primary gaze direction 22 and/or 24.Here, the control unit 18 may be configured to operatively amplifysounds in the primary gaze direction 22 and/or 24 at the distanceobtained by the distance measuring unit 16.

The control unit 18 of the sound recording arrangement 10 may beconfigured to operatively reduce the amplification when the time duringwhich the primary gaze direction 22 and/or 24 remains the same dropsbelow a predetermined threshold and/or the frequency at which the sameprimary gaze direction 22 and/or 24 is repeatedly determined drops belowa predetermined threshold.

The control unit 18 of the sound recording arrangement 10 may beconfigured to operatively reduce the amplification when no sound isrecorded in the primary gaze direction 22 and/or 24 during apredetermined period.

The control unit 18 of the sound recording arrangement 10 may beconfigured to operatively raise the amplification when the time duringwhich the primary gaze direction 22 and/or 24 remains the same, and/orthe frequency at which the primary gaze direction 22 and/or 24 isrepeated goes above a predetermined threshold.

The control unit 18 of the sound recording arrangement 10 may beconfigured to operatively raise the amplification gradually.

The control unit 18 of the sound recording arrangement 10 may beconfigured to operatively raise the amplification immediately when thecurrent primary gaze direction 22 and/or 24 is the same as a previouslydetermined primary gaze direction.

The control unit 18 of the sound recording arrangement 10 may beconfigured to operatively amplify sounds in the primary gaze direction22 and/or 24 even if there is currently no sound arriving at the soundrecording unit 12 in the primary gaze direction 22 and/or 24.

The embodiments discussed above may be summarized in the followingmanner:

One embodiment of the present solution may be directed to a method inthe sound recording arrangement 10 for amplifying sounds in a primarygaze direction of the user 20 of the sound recording arrangement 10. Themethod may comprise the actions of recording sounds arriving at thesound recording unit 12 from objects 40 a and/or 40 b in the field ofview of the user 20, and recording a first set of images of the headand/or the eyes of the user 20, and determining a primary gaze direction22 and/or 24 of the user 20 based on the first set of images, andamplifying sounds arriving in the primary gaze direction 22 and/or 24compared to sounds arriving from other directions.

The method may also comprise the actions of determining a secondary gazedirection of the user 20 based on the first set of images, anddetermining the primary gaze direction 22 and/or 24 of the user 20 basedon the first set of images and based on a correlation of the secondarygaze direction and an object tracking of the object 40 a and/or 40 b inthe second set of images.

The method may also comprise the actions of recording the sounds fromobjects in the field of view of a user 20 using at least two soundrecording devices 12 a and 12 b, or using at least three sound recordingdevices 12 a, 12 b and 12 c, and then amplifying sounds in the primarygaze direction 22 and/or 24 in one angular dimension based on soundsrecorded from said at least two sound recording devices 12 a and 12 b,or in two angular dimensions based on sounds recorded from said at leastthree sound recording devices 12 a, 12 b and 12 c.

The method may also comprise the actions of obtaining the distance to anobject 40 a and/or 40 b in the primary gaze direction 22 and/or 24respectively, and amplifying sounds in the primary gaze direction 22and/or 24 respectively at the distance obtained by the distancemeasuring unit 16.

The method may also comprise the actions of reducing the amplificationwhen the time during which the primary gaze direction 22 and/or 24remains the same drops below a predetermined threshold, and/or thefrequency at which the same primary gaze direction 22 and/or 24 isrepeatedly determined, drops below a predetermined threshold.

The method may also comprise the actions of reducing the amplificationwhen no sound is recorded in the primary gaze direction 22 and/or 24during a predetermined period.

The method may also comprise the actions of raising the amplificationwhen the time during which the primary gaze direction 22 and/or 24remains the same, and/or the frequency at which the primary gazedirection 22 and/or 24 is repeated, goes above predetermined threshold.

The method may also comprise the actions of raising the amplificationgradually.

The method may also comprise the actions of raising the amplificationimmediately when the current primary gaze direction 22 and/or 24 is thesame as a previously determined primary gaze direction.

The method may comprise the actions of amplifying sounds in the primarygaze direction 22 and/or 24 even if there is currently no sound arrivingat the sound recording unit 12 in the primary gaze direction 22 and/or24.

The present invention has now been described with reference toexemplifying embodiments. However, the invention is not limited to theembodiments described herein. On the contrary, the full extent of theinvention is only determined by the scope of the appended claims.

1. A sound recording arrangement comprising: a sound recording unit (12)capable of operatively record sound arriving at the sound recording unitfrom objects in the field of view of a user of the sound recordingarrangement, wherein: a first image recording unit is configured tooperatively record a first set of images of the head and/or the eyes ofthe user, a control unit is configured to operatively determine aprimary gaze direction of the user based on the first set of images, andthe control unit is further configured to operatively amplify soundsarriving in the primary gaze direction compared to sounds arriving fromother directions.
 2. The sound recording arrangement according to claim1, wherein: the control unit is configured to operatively determine asecondary gaze direction of the user based on the first set of images,the sound recording arrangement comprises a second image recording unitconfigured to operatively record a second set of images of an objectlocated in the secondary gaze direction, and the control unit isconfigured to operatively determine the primary gaze direction of theuser based on the first set of images and based on a correlation of thesecondary gaze direction and an object tracking of the object in thesecond set of images.
 3. The sound recording arrangement according toclaim 1, wherein: the sound recording unit comprises a cluster of atleast two sound recording devices or at least three sound recordingdevices each capable of operatively record sounds from objects in thefield of view of a user, and the control unit is configured tooperatively amplify sounds in the primary gaze direction in one angulardimension using said at least two sound recording devices, or in twoangular dimensions using said at least three sound recording devices. 4.The sound recording arrangement according to claim 1, comprising adistance measuring unit configured to operatively obtain the distance toan object in the primary gaze direction, wherein: the control unit isconfigured to operatively amplify sounds in the primary gaze directionat the distance obtained by the distance measuring unit.
 5. The soundrecording arrangement according to claim 1, wherein: the control unit isconfigured to operatively reduce the amplification when the time duringwhich the primary gaze direction remains the same drops below apredetermined threshold and/or the frequency at which the same primarygaze direction is repeatedly determined drops below a predeterminedthreshold.
 6. The sound recording arrangement according to claim 1,wherein: the control unit is configured to operatively reduce theamplification when no sound is recorded in the primary gaze directionduring a predetermined period.
 7. The sound recording arrangementaccording to claim 1, wherein: the control unit is configured tooperatively raise the amplification when the time during which theprimary gaze direction remains the same and/or the frequency at whichthe primary gaze direction is repeated goes above a predeterminedthreshold.
 8. The sound recording arrangement according to claim 7,wherein: the control unit is configured to operatively raise theamplification gradually.
 9. The sound recording arrangement according toclaim 8, wherein: the control unit is configured to operatively raisethe amplification immediately when the current primary gaze direction isthe same as a previously determined primary gaze direction.
 10. Thesound recording arrangement according to claim 1, wherein: the controlunit is configured to operatively amplify sounds in the primary gazedirection even if there is currently no sound arriving at the soundrecording unit in the primary gaze direction.
 11. A method in a soundrecording arrangement for amplifying sounds in a primary gaze directionof a user of the sound recording arrangement, which method comprises:recording sounds arriving at a sound recording unit from objects in thefield of view of the user, recording a first set of images of the headand/or the eyes of the user, determining a primary gaze direction of theuser based on the first set of images, and amplifying sounds arriving inthe primary gaze direction compared to sounds arriving from otherdirections.
 12. The method according to claim 11, which methodcomprises: determining a secondary gaze direction of the user based onthe first set of images, determining the primary gaze direction of theuser based on the first set of images and based on a correlation of thesecondary gaze direction and an object tracking of the object in thesecond set of images.
 13. The method according to claim 11, which methodcomprises: recording the sounds from objects in the field of view of auser using at least two sound recording devices, or using at least threesound recording devices, and amplifying sounds in the primary gazedirection in one angular dimension based on sounds recorded from said atleast two sound recording devices, or in two angular dimensions based onsounds recorded from said at least three sound recording devices. 14.The method according to claim 11, which method comprises: obtaining thedistance to an object in the primary gaze direction, amplifying soundsin the primary gaze direction at the distance obtained by the distancemeasuring unit.
 15. The method according to claim 11, which methodcomprises: reducing the amplification when the time during which theprimary gaze direction remains the same drops below a predeterminedthreshold and/or the frequency at which the same primary gaze directionis repeatedly determined drops below a predetermined threshold.
 16. Themethod according to claim 11, which method comprises: reducing theamplification when no sound is recorded in the primary gaze directionduring a predetermined period.
 17. The method according to claim 11,which method comprises: raising the amplification when the time duringwhich the primary gaze direction remains the same and/or the frequencyat which the primary gaze direction is repeated goes above predeterminedthreshold.
 18. The method according to claim 17, which method comprises:raising the amplification gradually.
 19. The method according to claim11, which method comprises: raising the amplification immediately whenthe current primary gaze direction is the same as a previouslydetermined primary gaze direction.
 20. The method according to claim 11,which method comprises: amplifying sounds in the primary gaze directioneven if there is currently no sound arriving at the sound recording unitin the primary gaze direction.